CLAIMS 

1. A texture information assignment method for a shape model, 
comprising the steps of: / 

describing a shape of an object of interest as a shape model by a set 
of a plurality of three-dimensional shape constituent elements/and 

assigning texture information for said shape model to /ach said 
three-dimensional shape constituent element on the basis of a plurality of 
object image information captured by shooting said object^f interest from 
different viewpoints, according to a texture information/amount for said 
three-dimensional shape constituent element of said each object image 
information. / 

2. The texturelMgrmation assignment method according to claim 1 
wherein said texture (irpormStmn amount is represented by a matching 
degree between a direction afias^rface norma/of said each three- 
dimensional shape constituent element and/a direction in which said each 
object image information i^cao^ured each /or said object three-dimensional 
shape constituent element. ^ / 

3. The texture information assignment method according to claim 1 
wherein said texture information amount is represented by an area of said 
three-dimensional shape constituent element projected on said each object 
image information each for said/three- dimensional shape constituent 
element. / 

4. A texture information assignment method for a shape model 
comprising the steps of: / 

describing a shape of an object of interest as a shape model by a set 
of a plurality of three-dimensional shape constituent elements; and 

assigning textiare information for said shape model to each said 
three-dimensional shape constituent element on the basis of a plurality of 
object image information captured by shooting said object of interest from 
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different viewpoints, according to both a texture information amount 
said three-dimensional shape constituent element of said each objectimage 
information and texture continuity between said three-dimensional/shape 
constituent elements. 
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5. The texture information assignment method according to claim 4, 
wherein said step of assigning texture information comprises the step of 
assigning texture information for said shape model from said object image 
information corresponding to each said three-dimensional shape 
constituent element so as to minimize an evaluation function that 
decreases in accordance with increase of said texturer information amount 
and that decreases in accordance with improvement in the texture 
continuity betweer^aidrhree-dimensional shappconstituent elements. 

6. The texture iipQrmation assignment method according to claim 5, 
wherein said evaluation function has said texture continuity represented as 
a function of difference in a shooting position and a shooting direction of 
respective said object image informatior/between a three-dimensional 
shape constituent element of interest find a three-dimensional shape 
constituent element adjacent theretc 



7. The texture information assignment method according to claim 5, 
wherein said evaluation function has said texture continuity represented as 
a function that increases in accordance with increase of difference between 

25 a label number assigned to/a three-dimensional shape constituent element 
of interest and a label nuinber assigned to a three-dimensional shape 
constituent element adjacent to said three-dimensional shape constituent 
element of interest when said object image information is captured 
according to change m position and a label number corresponding to the 

30 change in position is assigned to each object image information. 



8. The texture information assignment method according to claim 5, 
wherein said evaluation function has said texture continuity represented as 
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a function that increases in accordance with increase of difference betwee 
a label number assigned to a three-dimensional shape constituent element 
of interest and a label number assigned to a three-dimensional shape 
constituent element adjacent to said three-dimensional shape constituent 
element of interest when said object image information is captured, 
according to regular change in position and a label number is assigned to 
each object image information. 

9. The texture information assignment method according to claim 5, 
wherein said evaluation function has said texture information amount 
represented as a function of an area of said three-dimensional shape 
constituent element projected on said each object image information each 
for said three-dimensional shape constituent element. 



15 10. The/textuj^Kmforin^ation assignment method according to claim 

5, wherein said evaluation function has said texture information amount 
represented as a function of a/matching'aegree between a direction of a 
surface normal of said eacjafxhree-diinensional shape constituent element 
and a direction in which said each/object image information is captured 
20 each for said three-dimensional,snape constituent element. 



1 1. The texture information assignment method according to claim 
5, wherein said evaluatioia function is represented as a linear combination 
of a total sum for all three-dimensional shape constituent elements Of the 

25 difference between a label number assigned to the i-th (i: natural number) 
three-dimensional shape constituent element and a label number assigned 
to a three-dimensioned shape constituent element adjacent to said i-th 
three-dimensional shape constituent element, and a total sum for all three- 
dimensionaLshape constituent elements of an area of said i-th three- 

30 dimensional shape constituent element projected on said object image 

information corresponding to the label number assigned to said i-th three- 
dimensional shape constituent element. 
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12. A texture information assignment method for a shape moflel 
comprising the steps of: 

describing a shape of an object of interest as a shape model/by a set 
of a plurality of three-dimensional shape constituent elements; 

when a plurality of object image information are captured according 
to change in position and a label number corresponding to change in 
position is assigned to said each object image information/relating 
correspondence between said three-dimensional shape constituent element 
and said label number so as to minimize an evaluation! function that 
decreases in accordance with increase of a texture information amount for 
said each three-dimensional shape constituent element and that decreases 
in accordance with improvement in texture continuity of texture 
information resjjeretrvery assigned to said eachthree-dimensional shape 
constituent element and ^rfhree-Himensional shape constituent element 
adjacent thereto; a 

assigning texture information to/laid three-dimensional shape 
constituent element by carrying out ^weighted mean process according to 
an area of said three-dimensional shape constituent element projected on 
said each object image inrormatyzm on the basis of object image information 
corresponding to said related label number and the object image 
information coiTespoiyding tc/a predetermined number of label numbers 
including said related laber number. 



13. A texture information assignment method for a shape model 
25 comprising the steps/of: 

describing a^shape of an object of interest as a shape model by a set 
of a plurality of mree-dimensional shape constituent elements; 

when a plurality of object image information are captured in 
accordance with regular change in position and a label number is assigned 
30 to each said object image information, relating correspondence between 
each saici three-dimensional shape constituent element and said label 
number so as to minimize an evaluation function that decreases in 
accordance with increase of a texture information amount corresponding to 
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said each three-dimensional shape constituent element, and that decreases 
in accordance with improvement in texture continuity of texture 
information respectively assigned to said each three-dimensional snape 
constituent element and a three-dimensional shape constituent ele^nent 
adjacent thereto; and 

assigning texture information to said three-dimensional jghape 
constituent element by carrying out a weighted mean process/according to 
an area of said three-dimensional shape constituent elemenx projected on 
said each object image information on the basis of the object image 
information corresponding to said related label number and the object 
image information corresponding to a predetermined'number of label 
numbers including said related label number. 
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14. A textur 
comprising the s> 

capturing a pi 
object of interest from 

describing a shape 
of a plurality of three-di 




mation assignment/method for a shape model 



?ct image information by shooting an 
'viewpoints; 

objeex of interest as a shape model by a set 
taLsnape constituent elements; and 
assigning, to each said three-dimensional shape constituent element, 
texture information obtained by carrying out a weighted mean process for a 
plurality of said object images information according to an area of said 
three-dimensional shape constituent element projected on said plurality of 
object image information/respectively. 

15. A mediurn/storing a program for causing a computer to assign 
texture information/to a shape model, said program comprising the steps of: 

describing a shape of an object of interest as a shape model by a set 
of a plurality ofihree-dimensional shape constituent elements; and 

assigning texture information for said shape model to each said 
three-dimensional shape constituent element on the basis of a plurality of 
object image information captured by shooting said object of interest from 
different-viewpoints, according to a texture information amount for said 
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three-dimensional shape constituent element of said each object jmage 
information. 

16. The medium storing the texture information assignment 
program according to claim 15, wherein said texture information amount is 
represented by a matching degree of a direction of a surface normal of said 
each three-dimensional shape constituent element and/a direction in which 
said each object image information is captured each for said object three- 
dimensional shape constituent element. 



pq 17. The medium storing the texture information assignment 

W program accordingto_slaim 15, wherein said texture information amount is 

~ represented by-an area of said-three-dimensifonal shape constituent 

N» element projected oXsaweach objject image information each for said 

15 three-dimpnsional sha^e^s^nstitupnt element. 

j~ 18. A medium storing program for causing a computer to assign 

texture information to a shape model, said program comprising the steps of: 
describing a shape «3f an object of interest as a shape model by a set 
20 of a plurality of three-dimensional shape constituent elements; and 

assigning texture information for said shape model to each said 
three-dimensional shape constituent element on the basis of a plurality of 
object image information captured by shooting said object of interest from 
different viewpoints, according to both a texture information amount for 
25 said three-dimensional /hape constituent element of said each object image 
information and texture continuity between said three-dimensional shape 
constituent elements' 

19. The medium storing the texture information assignment 
30 program according to claim 18, wherein said step of assigning texture 

information comprises the step of assigning texture information for said 
shape moderfrom said object image information corresponding to each said 
three-dimensional shape constituent element so as to minimize an 
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evaluation function that decreases in accordance with increase of sj 
texture information amount and that decreases in accordance witl 
improvement in the texture continuity between said three-dimensional 
shape constituent elements. 

20. The medium storing the texture information assignment 
program according to claim 19, wherein said evaluation function has said 
texture continuity represented as a function of diff erence in a shooting 
position and shooting direction of respective said object image information 
between a three-dimensional shape constituent element of interest and a 
three-dimensional shape constituent element adjacent thereto. 

21. The medium storing the texture information assignment 
program according to^elaim^^wiierein said'evaluation function has said 
texture continuity ^epresen^das atWnction that increases in accordance 
with increase of difference Hfetaveen^a label number assigned to a three- 
dimensional shape constituent ejemen't of interest and a label number 
assigned to a three-dimensional shape constituent element adjacent to said 
three-dimensional shape constituent element of interest when said object 
image information is captured according to change in position and a label 
number corresponding to change in position is assigned to each object 
image information. 

22. The medium storing the texture information assignment 
program according tj/claim 19, wherein said evaluation function has said 
texture continuity represented as a function that increases in accordance 
with increase m difference of a label number assigned to a three- 
dimensional shape constituent element of interest and a label number 
assigned to a .three-dimensional shape constituent element adjacent to said 
three-dimenlional shape constituent element of interest when said object 
image information is captured in accordance with regular change in 
position and a label number is assigned to each object image information. 
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23. The medium storing the texture information assignment, 
program according to claim 19, wherein said evaluation function has said 
texture information amount represented as a function of an area/of said 
three-dimensional shape constituent element projected on said/each object 
image information each for said three-dimensional shape constituent 
element. 



24. The medium storing the texture infoiTnatioh assignment 
program according to claim 19, wherein said evaluation function has said 
10 texture information amount represented as a function of a matching degree 
between a directiofl-ef a surface normal of said £ach three-dimensional 
shape constituent el^me^Tartd a direction in xvhich said each object image 
information/is captur^Q. each fo:q said three/dimensional shape constituent 
element. 




L 15 

fU 25. The medium storing the texture information assignment 

3- program according to clainl 19, wherein said evaluation function is 

H» represented as a hneaiydombinatefon of a total sum for all three-dimensional 

shape constituent elements ofme difference between a label number 
20 assigned to the i-th (i: natural number) three-dimensional shape 

constituent element and a/abel number assigned to a three-dimensional 
shape constituent elemervt adjacent to said i-th three-dimensional shape 
constituent element, ajid a total sum for all three-dimensional shape 
constituent elementyof an area of said i-th three-dimensional shape 
25 constituent elemenx projected on said object image information 

corresponding to4he label number assigned to said i-th three-dimensional 
shape constituent element. 



26/ A medium storing a program for causing a computer to assign 
30 textureyinformation to a shape model, said program comprising the steps of: 
'describing a shape of an object of interest as a shape model by a set 
of plurality of three-dimensional shape constituent elements; 

when a plurality of object image information are captured according 
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to change in position and a label number corresponding to change h/ 
position is assigned to said each object image information, relating 
correspondence between said each three-dimensional shape constituent 
element and said label number so as to minimize an evaluation function 
that decreases in accordance with increase of a texture information amount 
for said each three-dimensional shape constituent elemen^/and that 
decreases in accordance with improvement in texture corttinuity of texture 
information assigned to said each three-dimensional shape constituent 
element and a three-dimensional shape constituen^element adjacent 
thereto; and / 

assigning tex^fre in±Wm«tren to said threVdimensional shape 
constituent element by caring out ja weighted mean process according to 
an area of said three-dimensional sjiape constituent element projected on 
said each object image informatics/ on th/basis of object image information 
corresponding to said related laiJel nu/nber and the object image 
information corresponding to"1i predetermined number of label numbers 
including said related label number. 

27. A medium storing a program for causing a computer to assign 
texture information to a shape model, said program comprising the steps of: 

describing a sham? Qf an object of interest as a shape model by a set 
of a plurality of three-dimensional shape constituent elements; 

when a pluraj-fty of object image information is captured in 
accordance with regular change in position and a label number is assigned 
to said each object image information, relating correspondence between 
each said three-dimensional shape constituent element and said label 
number so as^to minimize an evaluation function that decreases in 
accordance/with increase of a texture information amount corresponding to 
said each/three-dimensional shape constituent element, and that decreases 
in accordance with improvement in texture continuity of texture 
information respectively assigned to said each three-dimensional three- 
dimfensional shape constituent element and a three-dimensional shape 
constituent element adjacent thereto; and 
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assigning texture information to said three-dimensional shapfe 
constituent element by carrying out a weighted mean process according to 
an area of said three-dimensional shape constituent element projected on 
said each object image information on the basis of the object image 
information corresponding to said related label number anjithe object 
image information corresponding to a predetermined nmnber of label 
numbers including said related label number. / 

28. A medium storing a program for causing a computer to assign 
texture information to a shape model, said progr&m comprising the steps of: 

capturing a plurality of object image information by shooting an 
object of interest from different viewpoints; / 

describing a shape of said object of^nterest as a shape model by a set 
of a plurality of^reVdiniensional shape constituent elements; and 

assigning, t6\Mch sard three-dimensional shape constituent element, 
texture information obtained by cai^ying out a weighted mean process for a 
plurality of said object image information according to an area of said 
three-dimensional shape constituent element projected on said plurality of 
object images information respectively. 

29. A texture information assignment apparatus for a shape model 
comprising: / 

means for describing a shape of an object of interest as a shape 
model by a set of a ^plurality of three-dimensional shape constituent 
elements; and / 

means fo/ assigning texture information for said shape model to each 
said three-dimensional shape constituent element on the basis of a 
plurality of ffoject image information captured by shooting said object of 
interest from different viewpoints, according to a texture information 
amount for said three-dimensional shape constituent element of said each 
object image information. 

/ 30. The texture information assignment apparatus according to 
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claim 29, wherein said texture information amount is represented Wa 
matching degree between a direction of a surface normal of said ezym three- 
dimensional shape constituent element and a direction in which^aid each 
object image information is captured each for said three-dimensional shape 
constituent element. 
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31. The texture information assignment apparatus according to 
claim 29, wherein said texture information amount is Represented by an 
area of said three-dimensional shape constituent element projected on said 
each object image information each for said three-dimensional shape 
constituent element. / 

32. A texture information assignment apparatus for a shape model, 
comprising: 

means for d^cribiJng^a-siape of an/6bject of interest as a shape 
model by a set of a plur^jMty of tkree-dinlensional shape constituent 
elements; and 

means for assigning texture information for said shape model each 
for said three-dimensional shape constituent element on the basis of a 
plurality of object image inTormafaon captured by shooting said object of 
image from different viexvpointfi, according to both a texture information 
amount for said three-dimensional shape constituent element of said each 
object image information ar/d texture continuity between said three- 
dimensional shape constituent elements. 

33. The textur/6 information assignment apparatus according to 
claim 32, wherein said means for assigning texture information assigns 
texture information for said shape model from said object image 
information corresponding to each said three-dimensional shape 
constituent eleinent so as to minimize an evaluation function that 
decreases in sfccordance with increase of said texture information amount 
and that decreases in accordance with improvement in the texture 
continuit/between said three-dimensional shape constituent elements. 
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34. The texture information assignment apparatus according to 
claim 33, wherein said evaluation function has said texture continuity 
represented as a function of difference in a shooting position a/d shooting 
direction of respective said object image information between^ three- 
dimensional shape constituent element of interest and a th/ee-dimensional 
shape constituent element adjacent thereto. 

35. The texture information assignment apparatus according to 
claim 33, wherein said evaluation function has said ifexture continuity- 
represented as a function that increases in accordance with increase of 
difference between a label number assigned to a three-dimensional shape 
constituent element of interest and a label number assigned to a three- 
dimensional shape cc*fsTijtuent element adjacent to said three-dimensional 
shape constituenyelenW^Finterest whenyfiaid object image information is 
captured according to change ih position and a label number corresponding 
to the change in position is assigned to each object image information. 

36. The texture ini&rmation/ssignment apparatus according to 
claim 33, wherein said evaluation function has said texture continuity 
represented as a function that increases in accordance with increase of 
difference between a label number assigned to a three-dimensional shape 
constituent element of interest and a label number assigned to a three- 
dimensional shape constituent element adjacent to said three-dimensional 
shape constituent element/of interest when said object image information is 
captured according to regular change in position and a label number is 
assigned to each object/image information. 

37. The texture information assignment apparatus according to 
claim 33, wherein/said evaluation function has texture information amount 
represented as af function of an area of said three-dimensional shape 
constituent element projected on said each object image information each 
for said thre/- dimensional shape constituent element. 
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38. The texture information assignment apparatus according to 
claim 33, wherein said evaluation function has said texture/Information 
amount represented as a function of a matching degree between a direction 
of a surface normal of said each three-dimensional shap Constituent 
element and a direction in which said each object image/information is 
captured each for said three-dimensional shape constiment element. 

39. The texture information assignment apparatus according to 
claim 33, wherein said evaluation function is represented as a linear 
combination of a total sum for all three-dimensional shape constituent 
elements of the difference between a label nunfiber assigned to the i-th (i: 
natural number) three-dimensional shape constituent element and a label 
number assignedtoa three-dimensional shape constituent element 
adjacent to sai.d i-th firee-dimensional shfape constituent element, and a 

imensional shai/e constituent elements of an area of 
mal shape con/tituent element projected on said 
object image mformationVoui-espondfrig to the label number assigned to 
said i-th three-dimensional/shape constituent element. 



total sum farall t 
said i-th three-dimen 
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40. A texture in|brmatio>n assignment apparatus for a shape model, 
comprising: 

means for describing a^hape of an object of interest as a shape 
model by a set of a plurality/of three-dimensional shape constituent 
elements; 

means for relating/when a plurality of object images information are 
captured according to cl/ange in position and a label number corresponding 
to change in position id assigned to said each object image information, 
correspondence between said three-dimensional shape constituent element 
and said label numj/er so as to minimize an evaluation function that 
decreases in accordance with increase of a texture information amount for 
said each three-d/mensional shape constituent element and that decreases 
in accordance w/th improvement in texture continuity of texture 
information respectively assigned to said each three-dimensional shape 



- 90 - 




10 



15 



20 



25 



30 



constituent element and a three-dimensional shape constituent element 
adjacent thereto; and 

means for assigning texture information to said>finee-dimensional 
shape constituent element by carrying out a weighteci mean process 
according to an area of said three-dimensional shape constituent element 
projected on said each object image information oil the basis of the object 
image information corresponding to said relatedaabel number and the 
object image information corresponding to a predetermined number of label 
numbers including said related label numbe/ 

41. A texture information assignment apparatus for a shape model, 
comprising: 

means for describing a shape of/an object of interest as a shape 
model by a set of a|plu*afcfy of three-dimensional shape constituent 
elements; 

means for relating, when a/plurality of object image information are 
captured in accordance with regdlar change in position and a label number 
is assigned to each said cfbject image information, correspondence between 
each said three-dimensional sfoape constituent element and said label 
number so as to minimize an evaluation function that decreases in 
accordance with increase of a texture information amount corresponding to 
said each three-dimensional shape constituent element, and that decreases 
in accordance with improvement in texture continuity of texture 
information respectively assigned to said each three-dimensional shape 
constituent element a4id a three-dimensional shape constituent element 
adjacent thereto; ar 

means for assigning texture information to said three-dimensional 
shape constituent; element by carrying out a weighted mean process 
according to an -area of said three-dimensional shape constituent element 
projected on said each object image information on the basis of object image 
information corresponding to said related label number and object image 
informatior/corresponding to a predetermined number of label numbers 
includingiaid related label number. 
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42. The texture information assignment apparatus for a shape 
model comprising: / 

means for capturing a plurality of object image information by 
shooting an object of interest from different viewpoints; 

means for describing-a shape of said object of interest as a shape 
model by a set of a plua-ahtj^i^b^e-dintensional shape constituent 
elements; and 

means for assigning^ each said three-dimensional shape 
constituent element, texture^formation obtained by carrying out a 
weighted mean processor a plurality of said object image information 
according to an area^ot said three-dimensional shape constituent element 
projected on saj^tplurality of object image information respectively. 

V\43. An object extraction apparatus for extracting an object portion 
by reinoVmg an undesired portion from an object image obtained by 
shooting anNjbject of interest, comprising: 

region segmentation means for dividing said object image into a 
plurality of regions\and 

extraction means^for identifying and extracting the object portion in 
said object image by a process of consolidating information of each pixel in 
said object image each for saiSsregion. 

44. The object extraction apparatus according to claim 43, wherein 
said process of consolidating informationofeach pixel in said object image 
each for said region in said extraction meansrs^he process of averaging 
information of each pixel in said object image eachsfor said region. 

45. The\bject extraction apparatus according to olaim 43 or 44, 
wherein said extraction means identifies and extracts the object portion in 
said object image by\a threshold process for information of each said pixel 
consolidated each for said region. 



46. The object extraction apparatus according to one of claims 43-45, 



wherein said information of each pixel in said object image is difference 
information obtained by a difference process between a background image 
obtained h\ shooting only a background of said object of interest and said 
object imaga 

47. The object extraction apparatus according to one of claims 43-45, 
wherein said extraction means comprises 

differenceWocessing means for carrying' out a difference process 
between a background image obtained by shooting only a background of 
said object of interest and,said object image; 

mean value obtaining means for obtaining a mean value of absolute 
values of difference obtained by said difference process in said each region, 
and \ 

threshold value processing means for comparing said mean value of 
absolute values of difference in said region with a predetermined value to 
extract a region having saiti mean value of at least said predetermined 
value as the object portion. \ 

48. The object extraction apparatus according to any of claims 43- 
45, wherein said extraction means comprises 

mean value calculating meaks for calculating a mean value of pixels 
in each region of said object image, \ 

difference processing means forVarrying out a difference process 
between a mean value of pixels in each\egion of said object image and a 
mean value of pixels in a region of said background image corresponding to 
said region of said object image, and \ 

threshold value processing means for comparing an absolute value of 
difference obtained by said difference processing means with a 
predetermined value to extract a region having $aid absolute value of 
difference of at least said predetermined value as\he object portion. 

49. The object extraction apparatus according: to any of claims 43- 
45, wherein said information of each pixel in said objeV image is depth 
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information. 

50. An object extraction method for extracting an object portion by 
removing an undesired portion from an object image obtained by shooting 
an objectxrf interest, comprising: 

a region segmentation step of dividing said object image into a 
plurality of regions; and 

an extraction step of identifying and extracting the object portion in 
said object image by\process of consolidating information of each pixel in 
said object image each for said region. 
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51. The object extraction method according to claim 50, wherein 
said step of consolidating information of each pixel in said object image 
each for said region in said extractioirstep is the process of averaging 
information of each pixel in said object inrage each for said region. 
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52.V The object extraction method accorchngHQclaim 50 or 51, 
'wherein saiii extraction step identifies and extracts theobject portion in 
said object imaee by a threshold process for information of each said pixel 
consolidated each for said region. 
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53. The object extraction method according to one of claims 50-52, 
wherein said information of said each pixel in said object image is 
difference information bbtained by a difference process between a 
background image obtained by shooting only a background of said object of 
interest and said object imkge. 
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54. The object extraction method according to any of claims 50-52, 
wherein said extraction step comprises 

a difference processing step\of carrying out a difference process 
between a background image obtained by shooting only a background of 
said object of interest and said objectWage, 

a mean value obtaining step of obtaining a mean value of absolute 
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ference obtained by said difference process in said each region, 



values of 
and 

a threshold value processing step of comparing said mean value of 
absolute values of difference in said region with a predetermined value to 
extract a regioA having said mean value of at least said predetermined 
value as the obj\ct portion. 
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55. The obtect extraction method according to any of claims 50-52, 
wherein said extraction step comprises 

a mean value Calculating step of calculating a mean value of pixels in 
each region of said object image, 

a difference processing step of carrying out a difference process 
between a mean value M pixels in each region of said object image and a 
mean value of pixels in k region of said background image corresponding to 
said region of said objectUmage, and 

a threshold value processing step of comparing an absolute value of 
difference obtained by said difference processing with a predetermined 
value to extract a region haVing said absolute value of difference of at least 
said predetermined value as\the object portion. 

56. The object extraction method according to any of claims 50-52, 
wherein said information of eajh pixel in said object image is depth 
information. 
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.57. A medium storing a program for causing a computer to extract 
an object-portion by removing an undesired portion from an object image 
obtained by smiting an object of interest, said program comprising: 

a region segmentation step of dividing said object image into a 
plurality of regions; anc 

an extraction step of id^i^ifying and extracting the object portion in 
said object image by a process of corl&eJidating information of each pixel in 
said object image each for said region. 
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medium storing the object extraction program according to 
claim 57, wher&in said process of consolidating information of each pixel in 
said object image e&ch for said region in said extraction step is the process 
of averaging informatithvof each pixel in said object image each for said 
region. 



59. The medium storing the object extraction program according to 
claim 57 or 58, wlWein said extraction step identifies and extracts the 
object portion in said object image by a threshold value process for 
information of said each pixel consolidated each for said region. 



60. The medium\stoiing the object extraction program according to 
one of claims 57-59, wherein said information of each pixel in said object 
image is difference information obtained by a difference process between a 
background image obtained lV shooting only a background of said object of 
interest and said object image. 

The medium storing the object extraction program according to 
one of claim\57-59, 

wherein said extraction step comprises 

a difference s jn-ocessing step of carrying out difference processing 
between a backgrounUimage obtained by shooting only a background of 
said object image and said object image, 

a mean value obtaining step of obtaining a mean value of absolute 
values of difference obtained byS^aid difference process in said each region, 
and 

a threshold value processing steX of comparing said mean value of an 
absolute values of difference in said regio\with a predetermined value to 
extract a region having said mean value of aHeast said predetermined 
value as the object portion. 



62. The medium storing the object extraction prcJgram according to 
one of claims 57-59, whe\ein said extraction step comprises 
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a mean vklue calculating step of calculating a mean value of pixels in 
each region of said object image, 

a difference processing step of carrying out a difference process 
between a mean value of pixels in each region of said object image and a 
mean value of pixel\ in a region of said background image corresponding to 
said region of said oogect image, and 

a threshold val&e processing step of comparing an absolute value of 
difference obtained by Wid difference processing step with a predetermined 
value to extract a regionXhaving said difference absolute value of difference 
of at least said predetermined value as the object portion. 

63. The medium storing the object extraction program according to 
one of claims 57-59, wherein Said information of each pixel in said object 
image is depth information. \ 

\ W ' An object extraction apparatus for extracting an object portion 
by removing an undesired portion from an object image obtained by 
shooting anobject of interest, comprising: 

depth information calculating means for calculating depth 
information of s^d object image; 

region segmentation means for dividing said object image into a 
plurality of regions; X. 

mean value calculalsjng means for calculating a mean value of said 
depth information each for sa^xi region; and 

extraction means for extracting as said object portion a region having 
said mean value within a predetermined range out of said plurality of 
regions. >v 

65. An object extraction method of extracting an object portion by 
removing an undesired portion from an object image obtained by shooting 
an object of interest, comprising the steps of; >v 

calculating depth information of said object information, 
dividing said object image into a plurality of regions*. 



\ calculating a mean value of said depth information each for said 
region, and 

^extracting as said object portion a region having said mean value 
within ^predetermined range out of said plurality of regions. 

66. \A medium storing a program for causing a computer to extract 
an object portion by removing an undesired portion from an object image 
obtained by snooting an object of interest, said program comprising the 
steps of: \ 

calculating\depth information of said object information; 

dividing saickobject image into a plurality of regions; 

calculating a r^ean value of said depth information each for said 
region; and \ 

extracting as saidVbject portion a region having said mean value 
within a predetermined raVge out of said plurality of regions. 

67. An object extractidta apparatus for extracting an object portion 
by removing a background portion from an object image obtained by 
shooting an object of interest on the basis of said object image and a 
plurality of background images obtained by shooting only a background of 
said object of interest a plurality of tiVes, comprising: 

difference means for calculating an absolute value of difference 
between said object image and said background image; 

extraction means for extracting as sard object portion a portion of 
said object image having said absolute value of difference greater than a 
threshold value; and \ 

threshold value determination means for determining said threshold 
value in a statistical manner according to image information distribution of 
said plurality of background images. \ 

68. An object extraction apparatus for extracting ar\pbject portion 
by removing an undesired portion from an object image obtained by 
shooting an object of interest, on the basis of said object image and a 
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hu-ality of background images obtained by shooting only a background of 
sard object of interest a plurality of times, comprising: 

calculating means for calculating a mean value and standard 
deviation of pixels located at same coordinates in said plurality of 
background images each for said pixel; 

difference means for calculating an absolute value of difference 
between a value of each pixel in said object image and a mean value of 
pixels in said background image coii-esponding to said pixel; and 

extraction\means for extracting as said object portion a pixel having 
said absolute valuV of difference greater than a predetermined times said 
standard deviation dut of the pixels in said object image. 



i=a= 
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69. An object extinction apparatus for extracting an object portion 
by removing an undesiredVntion from an object image obtained by 
shooting an object of interest\on the basis of said object image and a 
plurality of background images\obtained by shooting only a background of 
said object of interest a plurality\f times, comprising: 

average/standard deviation Calculating means for calculating a mean 
value and standard deviation of pixels located at the same coordinates in 
said plurality of background images ea\h for said pixel, 

region segmentation means for dividing said object image into a 
plurality of regions; 

difference means for calculating an absolute value of difference 
between a value of each pixel in each region of\aid|6^jecTinTage and a 
mean value of corresponding pixels in a region of\a\d backgroumTlm-age 
corresponding to said region; 

mean difference calculating means for calculating a mean value of 
said absolute values of difference each for said region; 

mean standard deviation calculating means for calculating a mean 
value of said standard deviation each for said region; and 

extraction means for extracting as said object portion. a\egion having 
a mean value of said absolute values of difference greater than a\ 
predetermined times the mean value of said standard deviation ouYof said 
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\ 70. An object extraction apparatus for extracting an object portion 
by removing an undesired portion from an object image obtained by 
shootine an object of interest, on the basis of said object image and a 
plurality; of background images obtained by shooting only a background of 
said object of interest a plurality of times, comprising: 

average/standard deviation calculating means for calculating a mean 
value and standard deviation of pixels located at same coordinates in said 
plurality of background images each for said pixel; 

region segmentation means for dividing said object image into a 
plurality of regions^ 

mean calculating means for calculating a mean value of pixels in 
each region of said object image; 

difference means ±W calculating an absolute value of difference 
between a mean value of pixels in each region of said object image and a 
mean value of pixels in a region of said background image corresponding to 
said region; \ 

mean difference calculating means for calculating a mean value of 
said absolute value of difference each for said region; 

mean standard deviation calculating means for calculating a mean 
value of said standard deviation eachNfor said region; and 

extraction means for extracting as said object portion a region having 
a mean value of said absolute value of difference greater than a 
predetermined times the mean value of sai\standard deviation out of said 
plurality of regions. \ 

71. An object extraction apparatus for extracting an object image by 
removing an undesired portion from an object imagXpn the basis of a 
plurality of object images obtained by shooting an objefct of interest a 
plurality of times and a plurality of background images obtained by 
shooting only a background of said object of interest a plurality of times, 
comprising: \ 



plurality of regions 
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\ means/standard deviation calculating means for calculating a mean 
value and standard deviation of pixels located at same coordinates in said 
plurality of background images each for said pixel; 

Wean calculating means for calculating a mean value of pixels 
locatedv at same coordinates in said plurality of object images each for said 
pixel; \ 

region segmentation means for dividing said object image into a 
plurality of! regions; 

difference means for calculating an absolute value of difference 
between saidtoean value of each pixel in each region of said object image 
and said mean Value of corresponding pixel in a region of said background 
image corresponding to said region; 

mean difference calculating means for calculating a mean value of 
said absolute value of difference each for said region; 

mean standardMeviation calculating means for calculating a mean 
value of said standard deviation each for said region; and 

extraction means for extracting as said object portion a region having 
a mean value of said absolute value of difference greater than a 
predetermined times the mean value of said standard deviation out of said 
plurality of regions. \ 

72. An object extraction method of extracting an object portion by 
removing an un desired portion frorii an object image obtained by shooting 
an object of interest, on the basis of said object image and a plurality of 
background images obtained by shootiW only a background of said object of 
interest a plurality of times, comprising\he steps of: 

determining statistically a threshold value according to distribution 
of said plurality of background images; \ 

calculating an absolute value of difference between said object image 
and said background image; and \ 

extracting as said object portion a portion of said object image having 
said absolute value of difference greater than said threshold value. 
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\ 73. An object extraction method of extracting an object portion by 
removing an undesired portion from an object image obtained by shooting 
an object of the interest, on the basis of said object image and a plurality of 
background images obtained by shooting only a background of said object of 
interest a plurality of times, comprising the steps of: 

calculating a mean value and standard deviation of pixels located at 
the same coordinates in said plurality of background images each for said 
pixel; \ 

calculatingVn absolute value of difference between a value of each 
pixel in said object linage and a mean value of pixels in said background 
image corresponding to said pixel; and 

extracting as saicNobject portion a pixel having said absolute value of 
difference greater than a predetermined times said standard deviation out 
of the pixels in said object linage. 

74. An object extraction method of extracting an object portion by 
removing a background portion frofn an object image obtained by shooting 
an object of interest, on the basis of said object image and a plurality of 
background images obtained by shootinV only a background of said object of 
interest a plurality of times, comprising the steps of: 

calculating a mean value and standaM deviation of pixels located at 
the same coordinates in said plurality of background images each for said 
pixel; \ 

dividing said object image into a plurality or\regions; 

calculating an absolute value of difference betWeen a value of each 
pixel in each region of said object image and a mean vaiue of corresponding 
pixels in a region of said background image corresponding, to said region; 

calculating a mean value of said absolute value of difference each for 
said region; \ 

calculating a mean value of said standard deviation each lor said 
region; and \ 

extracting as said object portion a region having a mean value sf said 
absolute values of difference greater than a predetermined times the mesm 
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value of said standard deviation out of said plurality of regions. 

\75. An object extraction method of extracting an object portion by 
removing an undesired portion from an object image obtained by shooting 
an objectW the interest, on the basis of said object image and a plurality of 
backgrounadmages obtained by shooting only a background of said object of 
interest a plurality of times, comprising the steps of: 

calculating a mean value and standard deviation of pixels located at 
the same coordinates in said plurality of background images each for said 
pixel; \ 

dividing said object image into a plurality of regions; 

calculating a me\an value of pixels in each region of said object image; 

calculating an absolute value of difference between a mean value of 
pixels in each region in sa\d object image and a mean value of pixels in a 
region of said background u\age corresponding to said region; 

calculating a mean value of said absolute value of difference each for 
said region; \ 

calculating a mean value of^aid standard deviation each for said 
region; and \ 

extracting as said object portioii a region having a mean value of said 
absolute value of difference greater thak a predetermined times the mean 
value of said standard deviation out of sa\d plurality of regions. 

76. An object extraction method of extracting an object portion by 
removing an undesired portion from an object nsnage on the basis of a 
plurality of object images obtained by shooting a\ object of interest a 
plurality of times and a plurality of background images obtained by 
shooting only a background of said object of interest aSplurality of times, 
comprising the steps of: \ 

calculating a mean value and standard deviation of&ixels located at 
the same coordinates in said plurality of background images\ach for said 
pixel; \. 

calculating a mean value of pixels located at the same coordinates in 
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said plurality of object images each for said pixel; 

dividing said object image into a plurality of regions; 
calculating an absolute value of difference between said mean value 
of each pixel in each region of said object image and said mean value of 
corresponding pixel in a region of said background image corresponding to 
said region; 

calculating a mean value of said absolute value of difference each for 
said region^ 

calculating a mean value of said standard deviation each for said 
region; and \ 

extracting as said object portion a region having a mean value of said 
absolute value of difference greater than a predetermined times the mean 
value of said standard\eviation out of said plurality of regions. 

77. A medium storing a program for causing a computer to extract 
an object portion by removing\an undesired portion from an object image 
obtained by shooting an object of interest on the basis of said object image 
and a plurality of background images obtained by shooting a background of 
said object of interest a plurality ofNimes, said program comprising the 
steps of: \ 

determining statistically a threshold value according to distribution 
of said plurality of background images; \ 

calculating an absolute value of difference between said object image 
and said background image; \ 

extracting as said object portion a portion\of said object image having 
said absolute value of difference greater than sai\predetermined value. 

78. A medium storing a program for causing a\computer to extract 
an object portion by removing an undesired portion frorkan object image 
obtained by shooting an object of interest, on the basis of Smd object image 
and a plurality of background images obtained by shooting Only a 
background of said object of interest a plurality of times, said program 
comprising the steps of: \ 
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calculating a mean value and standard deviation of pixels located at 
the same coordinates in said plurality of background images each for said 
pixel; \ 

calculating an absolute value of difference between a value of each 
pixel in said oftiect image and a mean value of pixels in said background 
image corresponding to said pixel; and 

extractingNas said object portion a pixel having said absolute value of 
difference greateAhan a predetermined times said standard deviation out 
of the pixels in saidNpbject image. 

79. A mediumVtoring a program for causing a computer to extract 
an object portion by removing an undesired portion from an object image 
obtained by shooting an dbject of interest, on the basis of said object image 
and a plurality of background images obtained by shooting only a 
background of said object ofjnterest a plurality of times, said program 
comprising the steps of: \ 

calculating a mean value\and standard deviation of pixels located at 
the same coordinates in said plurality of background images each for said 
pixel; \ 

dividing said object image intcs a plurality of regions; 

calculating an absolute value o\difference between a value of each 
pixel in each region of said object image* and a mean value of corresponding 
pixels in a region of said background image corresponding to said region; 

calculating a mean value of said absolute value of difference each for 
said region; \ 

calculating a mean value of said standard deviation each for said 
region; and \ 

extracting as said object portion a region hVving a mean value of said 
absolute values of difference greater than a predetermined times the mean 
value of said standard deviation out of said plurahtjnof regions. 

80. A medium storing a program for causing a computer to extract 
an object portion by removing an undesired portion from aia object image 
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obtained by shooting an object of interest, on the basis of said object image 
and a plurality of background images obtained by shooting only a 
background of said object of interest a plurality of times, said program 
comprising the steps of: 

calculating a mean value and standard deviation of pixels located at 
the same coordinates in said plurality of background images each for said 
pixel; 

dividing said object image into a plurality of regions; 
calculating a mean value of pixels in each region of said object image; 
10 calculating an absolute value of difference between a mean value of 

pixels in each region in said object image and a mean value of pixels in a 
region of said background image corresponding to said region; 

calculating a mean value of said absolute value of difference each for 
said region; 

calculating a mea\ value of said standard deviation each for said 
: region; and 

i extracting as said object portion a region having a mean value of said 

absolute value of difference greater than a predetermined times the mean 
value of said standard deviation\out of said plurality of regions. 

20 

81. A medium storing a program for causing a computer to extract 
an object portion by removing an unoesired portion from an object image on 
the basis of a plurality of object imagesNobtained by shooting an object of 
interest a plurality of times and a plurality of background images obtained 
25 by shooting only a background of said objeo^ of interest a plurality of times, 
said program comprising the steps of: 

calculating a mean value and standard ^teviation located at the same 
coordinates in said plurality of background images each for said pixel; 

calculating a mean value of pixels located ar\the same coordinates in 
30 said plurality of object images each for said pixel; 

dividing said object image into a plurality of regions; 

calculating an absolute value of difference betweenssaid mean value 
of each pixel in each region of said object image and said mean value of 
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corresponding pixel in a region of said background image corresponding to 
said region; 

calculating a mean value of said absolute value of difference each for 
said region; 

calculating a mean value of said standard deviation each for said 
region; and 

extracting as said object portion a region having a mean value of said 
absolute value of difference greater than a predetermined times the mean 
value of said standard deviation out of said plurality of regions. 

82. A three-dimensional mode production apparatus for producing a 
three-dimensional model of an object of interest, comprising: / 

shooting means for shooting a background of said object ot interest 
and for shooting said object of interest including said background; 

silhouette production means for producing a plurality of silhouette 
images by obtaining difference between a background image obtained by 
shooting only said background and a plurality of objepx images obtained by 
shooting said object of inter es^rficTifchng said background; and 

means for producr^^a three-dimensional inodel of said object of 
interest using said plurality^ silhouette images. 

83. The three-dimensional modeLproduction apparatus according to 
claim 82, further comprising rotary means for rotating said object of 
interest. / / 

84. A three-(hmensionaLmodel production apparatus for producing 
a three-dimensional model of an object of interest, comprising: 

silhouette production/means for producing a plurality of silhouette 
images of said object of injrerest; 

estimation meamnfor estimating an existing region of said object of 
interest in voxel spac^ according to said plurality of silhouette images; and 

means for producing a three-dimensional model of said object of 
interest using saia existing region of said object of interest obtained by said 
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estimation means. 



85. The three-dimensional model production apparatus acceding to 
claim 84, wherein said estimation means carries out a voting process on 
said voxel space. / 

86. The three-dimensional model production apparatus according to 
claim 85, further comprising threshold value processing means for setting a 
portion having a voting score of at least a predetermined threshold value as 
said existing region of said object of interest as a/esult of said voting 
process. / 

87. A three-dimensional model pro-auction method of producing a 
three-aimensio^al^odBi-af an object ofinterest, comprising the steps of: 

shooting onlxk^ackgiound of said object of interest by a pickup 
device to obtain a background image; 

shooting said object/of interest including said background by said 
pickup device to obtainja plurality of object images; 

producing a pj*frality of silhouette images by obtaining difference 
between said background nftage and said plurality of object images; and 

producing a three-dimensional model of said object of interest using 
said plurality of silhouette images. 

88. The three-dimensional model production method according to 
claim 87, further/omprising the step of rotating said object of interest. 

89. A/three-dimensional model production method of producing a 
three- dimensional model of an object of interest, comprising the steps of: 

producing a plurality of silhouette images of said object of interest; 

estimating an existing region of said object of interest in voxel space 
according to said plurality of silhouette images; and 

/ producing said three-dimensional model using said estimated 
existing region of said object of interest. 
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90. The three-dimensional model production method according 
claim 89, wherein said step of estimating carries out a voting process/on 
said voxel space. 



10 
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91. The three-dimensional model production method/according to 
claim 90, further comprising the step of setting a portion having a voting 
score of at least a predetermined threshold value as sa>d existing region of 
said object of interest as a result of said voting procc 



an object of interest, said program comprising 
silhouette images from said object of 



92. A medium storing a program for causing a computer to produce 
a three-dimensj 
the steps of: 

produ' 
interest; 

estimating an existing regym of said object of interest in voxel space 
according to said plurality of simouette images and; 

producing said three-dimensional model using said estimated 
existing region of said object of interest. 

93. The medium storing the three-dimensional model production 
program accorchng>fo claim 92, wherein said step of estimating in said 
program carries /nit a voting process on said voxel space. 
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94. yfhe medium storing the three-dimensional model production 
program>dccording to claim 93, wherein said program further comprises the 
step offsetting a portion having a voting score of at least a predetermined 
threshold value as said existing region of said object of interest as a result 
oj'said voting process. 

9 5^-^An object extraction apparatus for extracting an object portion 
by removing an umiesired portion from an object image obtained by 
shooting an object of interest7*oa>the basis of said object image and a 
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^plurality of background images obtained by shooting only a background of 
>aid object of interest a plurality of times, comprising: 

^mean/standard deviation calculating means for calculating a mean 
valute and standard deviation of pixels located at the same coordinates in 
said plurality of background images each for said pixel ; 

region segmentation means for dividing said object image into a 
plurality oiNregions; 

mean calculating means for calculating a mean value of pixels in 
each region of said object image and a mean value in each region of the 
mean value of pixels in the background image; 

difference means for calculating an absolute value of difference 
between a mean value oroixels within each region of said object image and 
a mean value in the region of pixels in a region of said background image 
corresponding to said region; 

mean standard deviation calculating means for calculating a mean 
value of said standard deviation each for said region; and 

extraction means for extracting^ the object region a region having 
an absolute value of difference greater tlran a predetermined times the 
mean value of said standard deviation out of said plurality of regions. 



96. An object extraction method of extracting an object portion by 
removing an undesired portion from an object image obtained by shooting 
an object of interest, on the basis of said object imageVnd a plurality of 
background images obtained by shooting only a background of said object of 
interest a plurality of times, comprising the steps of: 

calculating a mean value and standard deviation of pixels located at 
the same coordinates in said plurality of background images ea^h for said 
pixel; 

dividing said object image into a plurality of regions; 

calculating a mean value of pixels in each region of said object\mage 
and a mean value in each region of the mean value of the pixels in the 
background image; 

calculating an absolute value of difference between a mean value of 
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\pixels within each region of said object image and a mean value in the 
xegion of pixels in a region of said background image corresponding to said 
region; 

V calculating a mean value of said standard deviation each for said 
regicni; and 

Nextracting as the object portion a region having an absolute value of 
difference greater than a predetermined times the mean value of said 
standard ^deviation out of said plurality of regions. 

97. Aft^edium storing a program for causing a computer to extract 
an object portiorr>by removing an undesired portion from an object image 
obtained by shooting an object of interest, on the basis of said object image 
and a plurality of background images obtained by shooting only a 
background of said object of interest a plurality of times, comprising the 
steps of: \ 

calculating a mean value and standard deviation of pixels located at 
the same coordinate in said plurality of background images each for said 
pixel; \ 

dividing said object image mto a plurality of regions; 

calculating a mean value of pixels in each region of said object image 
and a mean value in each region of th\ mean values of the pixels of the 
background image; \ 

calculating an absolute value of difference between a mean value of 
pixels within each region of said object image and a mean value in the 
region of pixels in a region of said backgroundsimage corresponding to said 
region; y 

calculating a mean value of said standard deviation each for said 
region; and \ 

extracting as the object portion a region having an absolute value of 
difference greater than a predetermined times the mean\alue of said 
standard deviation out of said plurality of regions. \ 
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